Goto

Collaborating Authors

 multi-head self-attention network


Dynamic Anomaly Identification in Accounting Transactions via Multi-Head Self-Attention Networks

arXiv.org Artificial Intelligence

This study addresses the problem of dynamic anomaly detection in accounting transactions and proposes a real-time detection method based on a Transformer to tackle the challenges of hidden abnormal behaviors and high timeliness requirements in complex trading environments. The approach first models accounting transaction data by representing multi-dimensional records as time-series matrices and uses embedding layers and positional encoding to achieve low-dimensional mapping of inputs. A sequence modeling structure with multi-head self-attention is then constructed to capture global dependencies and aggregate features from multiple perspectives, thereby enhancing the ability to detect abnormal patterns. The network further integrates feed-forward layers and regularization strategies to achieve deep feature representation and accurate anomaly probability estimation. To validate the effectiveness of the method, extensive experiments were conducted on a public dataset, including comparative analysis, hyperparameter sensitivity tests, environmental sensitivity tests, and data sensitivity tests. Results show that the proposed method outperforms baseline models in AUC, F1-Score, Precision, and Recall, and maintains stable performance under different environmental conditions and data perturbations. These findings confirm the applicability and advantages of the Transformer-based framework for dynamic anomaly detection in accounting transactions and provide methodological support for intelligent financial risk control and auditing.


Supplementary

Neural Information Processing Systems

Federated Fair Model Training The detailed workflow of our FairVFL method is summarized in Algorithm 1. Algorithm 1 Federated Model Training in FairVFL Next, we will introduce the basic models used for model training in details. Next, we will analyze the influence of the weights of adversarial learning on model fairness. We summarize results in Figure 1 and have several observations.